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(54) Portable terminal 

(57) The present invention was made to solve the 
problem that users cannot check e-mail containing an 
attached image at a glance on conventional portable ter- 
minals. According to the present Invention, there Is pro- 
vided a portable temiinal that can display the e-mail text 
overlapped upon the attached image in an easy-to-see 
manner, and hence Improve its usability as a mail re- 
ceiving terminal. 

An image processing/output means (14) converts 
the attached Image data Into image data of a size cor- 
responding to that of the display area, and processes 
the attached image data to correct either of the bright- 
ness and contrast thereof. Further, a character setting/ 
output means (1 5) sets display color of the mail text ac- 
cording to the chromaticity of the image data so that the 
mail text will be overlapped upon and displayed with the 
set display color against the background of the proc- 
essed image. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001] This invention relates to a potable ternninal 
having a function for sending and receiving e-mail, and 
in particular, to a potable terminal that can display e-mail 
with an Image attached thereto together with the at- 
tached image in an easy-to-see manner, and hence im- 
prove its usability. 

2. Description of the Related Art 

[0002] One method for attaching image data to e-mail 
on the Internet Is such that Image data, typically of a 
binary file, is converted into a text in a format such as 
Base 64 or Uuencode to send out the same immediately 
preceded by the e-mail text. Then, when the e-mail is 
received at a computer or portable tenninal, an electron- 
ic mall application automatically detects the attached file 
part immediately preceded by the e-mall text to return 
the file to its original state and store the same. 
[0003] There are various ways to display the e-mail 
text and the attached image received, depending upon 
the type of e-mail terminal used. In this case, if the dis- 
play area of the terminal Is too small, the e-mail text and 
the attached image may not be displayed at the same 
time. 

[0004] For example, a personal computer or portable 
terminal such as PDA (Personal Digital Assistants) the 
display area of which is relatively large can display the 
attached image in an area adjacent to the display area 
of the e-mail text. Even if the image is too large to be 
displayed on the screen, it can scroll around the image 
alone or the image plus the e-mail text to obtain such 
high viewability as to withstand some degree of usage. 
[0005] One prior art related to a display of Image in- 
formation such as e-mall Is disclosed in Japanese Pat- 
ent Application Laid-open No. 11-191836 entitled .Com- 
munication Apparatus and its Control l\/lethod. (Appli- 
cant: Canon, Inventors: Hideo Shibaoka et al.) pub- 
lished on July 13, 1999. 

[0006] This prior art discloses a communication appa- 
ratus and its control method designed to store a re- 
ceived or photographed image in association with 
prestored information on the communication partner 
and the like, and to edit and display the communication 
partner infonnation and the image on one screen. This 
makes it possible to refer to the image and the commu- 
nication partner information at the same time, and hence 
easy to retrieve any image. 

[0007] However, when e-mail with image data at- 
tached thereto is to be displayed on a temriinal the dis- 
play area of which is too small like a portable telephone, 
another method for displaying the same is employed, in 
this method, the attached Image is displayed below the 



e-mail text. Then, a screen scroll function to scroll 
around the attached Image is so used that the full-length 
Image will be displayed step by step, thus browsing the 
e-mail text and the attached image continuously In this 
5 order. 

[0008] However, it is almost impossible for the above- 
mentioned conventional portable ternninal, especialiy 
the one with a small display area, to provide a concur- 
rent display of the e-mall text and the attached Image, 
10 which results in inconvenience for the user because he 
or she cannot check the e-mail containing the attached 
image at a glance. 

SUMMARY OF THE INVENTION 

15 

[0009] It Is an object of the present Invention to pro- 
vide a portable terminal that can display an e-mail text 
by overlapping the same upon an attached image, and 
hence improve its usability as an e-mail receiving temil- 
20 nal. 

[0010] According to one aspect of the present inven- 
tion, there is provided a portable terminal including; a 
receiver for receiving image data and character data 
transmitted in association with each other; an input unit 

25 for inputting Instructions; a control unit for generating 
display data from the image data and the character data ; 
and a display unit for displaying the display data. The 
portable terminal features that the control unit generates 
the display data In such a manner that the associated 

30 character data are overlapped upon and displayed 
against the image data as the background. This makes 
it possible to display the received Image and character 
data on one screen in an easy-to-see manner, and 
hence improve its usability, 

35 [001 1 ] According to another aspect of the present in- 
vention, the above-mentioned portable terminal Is such 
that the character data represent an e-mail text and the 
image data represent an image attached to the e-mail. 
This makes it possible to display the character data of 

40 the e-mail with the Image data attached thereto together 
with the image data on one screen in an easy-to-see 
manner, and hence improve its usability. 
[0012] According to still another aspect of the present 
invention, the above-mentioned portable terminal Is 

45 such that the control unit converts the received Image 
data Into image data of a size corresponding to the dis- 
play area of the display unit to generate the display data. 
Therefore, even if the display area is smaller than the 
size of the received image data, the received image and 

so character data can be displayed on one screen in an 
easy-to-see manner, thus improving its usability. 
[001 3] According to yet another aspect of the present 
Invention, the above-mentioned portable terminal is 
such that the control unit processes the received image 

55 data to correct either or both of the brightness and con- 
trast thereof to generate the display. Therefore, when 
the character data are overlapped upon and displayed 
against the background of the received Image data, the 
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image data are made inconspicuous, thereby displaying 
the character data in an easy-to-see manner even In 
such bad condition that the characters are overlapped 
upon the image. 

[001 4J According to yet another aspect of the present 
invention, the above-mentioned portable terminal is 
such that the control unit sets display color of the re- 
ceived character data according to the chromaticity of 
the Image data to generate the display data. Therefore, 
when the character data are overlapped upon and dis- 
played against the background of the received image 
data, the image data are made inconspicuous, thereby 
displaying the character data in an easy-to-see manner 
even in such bad condition that the characters are over- 
lapped upon the image. 

[0015] According to still another aspect of the present 
invention, the above-mentioned portable terminal is 
such that, when two or more kinds of image data are 
received, the control unit changes the Image data to be 
displayed as the background in accordance with Instruc- 
tions from the input unit. This makes It easy to change 
the image data to be displayed as the background, thus 
improving Its usability. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 6] By way of exampi e and to make the description 
more clear, reference is made to the accompanying 
drawings In which: 

Fig. 1 is a block diagram of a configuration of a port- 
able terminal according to the present Invention; 
Fig. 2 Is a flowchart showing the flow of operations 
executed by mail display means in a control unit of 
the portable terminal according to the present in- 
vention; 

Fig. 3 is an illustration of an example of display on 
the portable terminal according to the present In- 
vention on which a text and an Image are over- 
lapped; 

Fig. 4 is an illustration of an example of e-mail text- 
only display on the portable terminal according to 
the present Invention; and 

Fig. 5 is an illustration of examples of image-only 
display on the portable terminal according to the 
present invention. 

< Description of Reference Numerats> 

[0017] 

1 . Antenna, 

2 . Duplexer, 

3 . Transmitter, 
4. . Receiver, 

5 . User Interface Unit, 

6 . Display Unit. 

7 . Memory Unit, 



8 . Mail Text Memory, 
9a. Image Data Memory, 
9b . Image Data Memory, 
10 . Control Unit, 
5 11 . Mall Receiving Means, 

12 . Image Data Decoding Means, 

13 . Mail Display Means, 

14 . Image Processing/Output Means, 

15 . Character Setting/Output Means, 
10 20 . Display Control Unit, 

21 . Address Controller, 

22 . Display Data RAM, 

23 . Display Driver. 

15 DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0018] The following describes an embodiment of the 
, present Invention with reference to the accompanying 
drawings. 

20 [0019] It should be noted that function performing 
means to be described below can be any means as long 
as they perfonn the functions concerned. In other words, 
the means can be any circuit or device, or part or all of 
the functions may be perfonned by software. Further, 

25 the function performing means may consist of two or 
more circuits, or two or more function performing means 
may be of a single circuit. 

[0020] The portable terminal according to the present 

Invention is designed to receive character data and im- 

30 age data transmitted in association with each other, con- 
vert the received image data into image data of a size 
corresponding to that of the display area, correct either 
or both of the brightness and contrast of the image data, 
and set display color of the received character data ac- 

35 cording to the chromaticity of the Image data to generate 
display data. Since the associated character data are 
overlapped upon and displayed against the background 
of the received image data, even if the display area is 
smaller than the size of the received image data, the 

40 received Image and character data can be displayed on 
one screen in an easy-to-see manner. Further, since the 
image data become Inconspicuous and the character 
data stand out against the background, the character 
data can be displayed in an easy-to-see manner even 

45 In such bad condition that the characters are overlapped 
upon the image. Thus the usability of the portable ter- 
minal Is improved. 

[0021] In particular, when the character data repre- 
sent an e-mail text and the Image data represent an Im- 

50 age attached to the e-mail, the portable terminal accord- 
ing to the present invention can display the character 
data of the e-mall with the Image data attached thereto 
together with the image data on one screen in an easy- 
to-see manner, thereby improving its usability. 

55 [0022] As forthe function perfonning means, the port- 
able terminal according to the present invention in- 
cludes a receiver for receiving image data and character 
data transmitted in association with each other and an 
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input unitfor inputting Instructions. The portableterminal 
also includes a'control unit that converts the image data 
into Image data of a size corresponding to the display 
area, processes the Image data to correct either or both 
of the brightness and contrast thereof, and sets display 
color of the character data according to the chromatlclty 
of the image data to generate display data from the im- 
age and character data in such a manner that the asso- 
ciated character data are overlapped upon and dis- 
played against the background of the image data. Fur- 
ther, the portable temninal includes a display unit for dis- 
playing the display data. Therefore, even If the display 
area Is smaller than the size of the received image data, 
the received image and character data can be displayed 
on one screen In an easy-to-see manner. Further, since 
the image data become inconspicuous and the charac- 
ter data stand out against the bacl<ground, the character 
data can be displayed in an easy-to-see manner even 
in such bad condition that the characters are overlapped 
upon the image. Thus the usability of the portable ter- 
minal is improved. 

[0023] Each means of the embodiment according to 
the present invention is made correspondent with each 
part or parts shown In Fig. 1. As shown, the receiver 
corresponds to an antenna 1 , a duplexer 2 and a receiv- 
er 4. The control unit corresponds to a control unit 10, 
a memory unit 7 and a display control unit 20. The dis- 
play unit corresponds to a display unit 6. 
[0024] Referring first to Fig. 1, description will be 
made about a configuration of the portable terminal ac- 
cording to the present invention. Fig. 1 is a block dia- 
gram of the portable tenninal according to the present 
invention, 

[0025] The portable terminal according to the present 
invention is constituted of: the antenna 1 for transmitting 
and receiving radio waves; the duplexer 2 that enables 
common use of the antenna for transmission and recep- 
tion; a transmitter 3 for controlling data transmission; the 
recelver4 for controlling data reception; a user interface 
unit 5 such as a key pad for use in inputting various func- 
tions on the portable temninal; the display unit 6 for dis- 
playing input data or received e-mail; the memory unit 
7 for storing various data; the control unit 1 0 for control- 
ling the entire portableterminal; and the display control 
unit 20 for controlling Indications on the display unit 6. 
[0026] As for each part of the portable terminal ac- 
cording to the present invention, the antenna 1 , the du- 
plexer 2, the transmitter 3, the receiver 4, the interface 
unit 5 and the display unit 6 are the same in configuration 
as those of an existing portable tenninal. Therefore, the 
description thereof will be omitted. Here, the parts relat- 
ed to the characteristics of the present invention will be 
described in detail below. 

[0027] The memory unit 7 is a memory unit for storing 
various data related to the portable terminal. Particular- 
ly, in the embodiment, the memory unit 7 includes a mail 
text memory 8 for storing a received e-mail text (char- 
acter data), an Image data memory 9a for storing image 



data attached to the received e-maif, and a temporary 
Image data memory 9b for temporarily storing proc- 
essed image data, 

[0028] It should be noted that the e-mail text stored in 

s the mall text memory 8 and the image data stored in the 
image data memory 9a are so held that they can be read 
out in association with each other. 
[0029] The display control unit 20 controls Indications 
on the display unit 6; it consists of an address controller 

10 21 , a display data RAM 22 and a display driver 23. 
[0030] The display data RAM 22 is a memory for stor- 
ing display data to be indicated on the display unit 6. 
[0031 ] The display driver 23 is a driver for driving the 
display unit 6 to Indicate the display data stored in the 

15 display data RAM 22. 

[0032] The address controller 21 Is a controller that 
perfomns address control to the display data RAM 22 to 
write the display data into the display data RAM 22. 
[0033] If the display data are character data, the ad- 

20 dress controller 21 converts the character data into dot 
data for character display, and controls the address to 
the dot data part for character display to write the display 
data onto the display data RAM 22 with a display color 
instructed by the control unit 10. 

25 [0034] The above-described structural elements are 
the same in configuration as those of conventional port- 
able tenninais. 

[0035] The portable tenninal according to the present 
invention features that the contents to be processed by 
30 the mall display means 13 in the control unit 10 to be 
described below are different from those of the conven- 
tional. Such a characteristic function of the present in- 
vention can be mounted on software executed by the 
control unit 1 0. 

35 [0036] The control unit 1 0 controls the entire portable 
tenninal, that Is, it performs various setting functions as 
well as communication and talking functions as a typical 
portable terminal. In the embodiment, the control unit 1 0 
further has a function for transmitting and receiving e- 

40 mail on which the portable terminal according to the 
present invention is predicated. 

[0037] According to the portable terminal of the 
present invention, the control unit 10 includes a mail re- 
ceiving means 11, an image data decoding means 12. 

45 and a mall display means 13 as characteristic parts of 
the present invention related to the reception and dis- 
play of e-mail. The mail display means 13 Includes an 
image processing means 14 and a character setting/ 
output means 15, 

50 [0038] The mail receiving means 1 1 is a means for 
receiving e-mail. If no file is attached to the e-mail, the 
mail receiving means 11 stores the e-mail Into the mail 
text memory 8 as It Is; while if a file (Image data) is at- 
tached to the e-mail, it stores them into a temporary 

55 memory, not shown, and activates the image data de- 
coding means 12. 

[0039] The image data decoding means 12 decodes 
the image file encoded by the sending side in a format 
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such as Base 64 or Uuencode to generate binary image 
data. According to the present invention, the image data 
decoding means 12 Is activated by the mail receiving 
means 11 in response to reception of e-mail with a file 
(image data) attached thereto. After activated, the im- 
age data decoding means 12 detects the Image data 
part attached to the e-mail text to decode the Image da- 
ta. Then , the e-mail text is stored Into the mail text mem- 
ory 8. while the image data are stored into the image 
data memory 9a, it should be noted that the e-mail text 
stored in the mall text memory 8 and the Image data 
stored in the image data memory 9a are so held that 
they can be read out in association with each other. 
[0040] The mail display means 1 3 is a means for dis- 
playing on the display unit 6 the received e-mail stored 
in the mail text memory 8 and the image data memory 
9a. 

[0041 ] To be more specific, the mail display means 1 3 
is activated in accordance with instructions from the us- 
er interface unit 5 to perfomi the function for displaying 
the received e-mail. After activated, the mail display 
means 1 3 provides control of the display of either the e- 
mall text or the image, or both the e-mail text and the 
image data by overlapping the e-maii text upon the im- 
age data, depending on the display mode preset or 
changed during operation. 

[0042] After the completion of the storage of either or 
both of the image and the character data of the mail text 
on the display data RAM 22 through the address con- 
troller 21, the display driver 23 reads out display data 
from the display data RAiVI 22 to output the same to the 
display unit 6. Thus the display data appear on the dis- 
play unit 6. 

[0043] There are the following display modes: a .text- 
only, mode for displaying e-mail text only, an .image-on- 
ly., mode for displaying image data only, and an .image 
and text, mode for displaying e-mail text overlapped up- 
on an attached image. Of all the modes, the .text-only, 
mode and the .image and text, mode can be preset. 
The . image-only, mode may be set during e-mail display 
so that only the attached image can be displayed by var- 
ying its scale. 

[0044] Further, the image processing/output means 
14 is so provided that the e-mail text and the attached 
image are displayed in an easy-to-see manner when the 
attached image Is displayed. The Image processing/out- 
put means 14 performs various processing for the re- 
ceived image data to instruct the display unit 6 to indi- 
cate the processed image data. On the other hand, the 
character setting/output means 15 is so provided that 
display color of the received e-mail text is set to Instruct 
the display unit 6 to indicate the e-mail text with the set 
display color. 

[0045] One specific example of the image processing 
carried out at the Image processing/output means 14 
comprises the following processing. First of all, image- 
size adjustment processing is so done that the image 
data received and stored in the image data memory 9a 



are adjusted in size to match the display area of the dis- 
play unit 6. Second, image correction processing is so 
done that either or both of the brightness and contrast 
of the image are corrected to make the image inconspic- 

s uous and hence the characters easy to see when the 
characters of the e-mail text are overlapped upon and 
displayed againstthe image. It should be noted that both 
the image-size adjustment andthe image correction use 
the temporary image data memory 9b to store the dis- 

10 play image data subjected to the final processing onto 
the display data RAM 22 through the address controller 
21 of the display control unit 20. 
[0048] If only the image Is displayed, image zooming 
Is done In accordance with instructions from the user to 

15 perform a function for varying the display scale. If the 
Image is zoomed in, the enlarged image data are stored 
into the temporary image data memory 9b of the mem- 
ory unit 7 so that the entire image is displayed by scroll- 
ing. Then, the enlarged image data temporarily stored 

20 are output in accordance with instmctions from the user 
Interface unit 5 to scroll the image screen. 
[0047] The image data thus generated are written on- 
to the display data RAM 22 through the address control- 
ler 21. 

25 [0048] It should be noted any specific method may be 
used to carry out the Image-size adjustment, the image 
con-ection and the image zooming, and the present in- 
vention is not limited to the specific method. 
[0049] Further, when the characters overlapped upon 

30 the image are displayed, the characters close In chro- 
maticity to the attached image may not be readable. 
From this standpoint, the character setting/output 
means 15 would be a means for making the characters 
conspicuous and hence easy to see. One specific ex- 

35 ample of methods for making the characters conspicu- 
ous is to set display color of the characters according to 
the chromaticity of the image data. Another example is 
to make two or more colors changeable in accordance 
with operations on the user interface unit 5. In this case, 

40 the chromaticity of the attached image data stored in the 
image data memory 9a of the memory unit 7 for use in 
generating the display data, or the chromaticity of the 
attached Image data stored in the temporary image data 
memory 9b after processed by the image processing/ 

45 output means 1 4 is so analyzed that the optimum, easy- 
to-seem color of the characters is selected on the basis 
of the analysis result and correspondence provided in 
advance to the analysis result. Further, colors of the 
characters may be varied step by step like .black., . 

50 white., .blue, and .red. by the user pressing specific 
keys assigned on the user Interface unit 5. 
[0050] Upon making a decision on the display color, 
the e-mail text is read out from the mall text memory 8 
of the memory unit 7. Then, the character data of the e- 

55 mall text and the character color are output to the ad- 
dress controller 21 . The address controller 21 writes on- 
ly the dot part for character display over the image data 
stored on the display data RAM 22 to overlap the char- 
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acters upon the image on the display data RAM 22. 
[0051 ] The following describes the flow of the mail dis- 
play processing performed by the mail display means 
13 with reference to Fig. 2. Fig. 2 Is a flowchart showing 
the flow of the processing performed by the mail display 
means 13 In the control unit 10 of the portable terminal 
according to the present Invention. 
[0052] The mail display processing performed by the 
mail display means 13 in the control unit 10 of the port- 
able terminal according to the present Invention is acti- 
vated in accordance with instructions fromthe user in- 
terface unit 5 to perfomri the function for displaying re- 
ceived e-mail. As shown in Fig. 2, a list of received e- 
mail stored In the mail text memory 8 is displayed on the 
display unit 6 (100), The user selects e-mail to be read 
out from the list through the user Interface unit 5 (104). 
It Is then determined whether or not a file is attached to 
the selected e-mail (1 06). If a file is attached (Yes), it is 
further detennined whether or not the attached file is an 
image file (108). 

[0053] If the attached file is an image data (Yes), it is 
determined whether the display mode is .text-only. 
(110), If not .text-only. (No), it Is next determined wheth- 
er the mode is .Image-only. (112). IF not .image-only. 
(No), it is recognized that the image and text are to be 
displayed by overlapped one upon another, and there- 
fore, the image processing/output means 14 is activated 
to perform the image processing/output processing 
(114). Then, the character setting/output means 15 is 
activated to perform the character setting/output 
processing (116). 

[0054] The image processing/output processing per- 
formed by the image processing/output means 14 in- 
cludes image-size adjustment processing for adjusting 
the size of the image to match the display area of the 
display unit 6, and Image correction processing for cor- 
recting the brightness and/or contrast of the image to 
make the characters conspicuous and hence easy to 
see when the characters of the e-mail text are over- 
lapped upon and displayed against the image. 
[0055] The character setting/output processing per- 
formed by the character setting/output means 16 in- 
cludes processing for selecting the optimum character 
color on the basid of the chromaticity of the image and 
processing for changing the character color at users 
discretion. 

[0056] Consequently, the Image data as the back- 
ground and dot data for displaying the characters of the 
character data of the e-mail text are written onto the dis- 
play data RAM 22 through the address controller 21 , and 
displayed on the display unit 6 by means of the display 
driver 23. 

[0057] Then, the procedure waits for key operation on 
the user interface unit 5 (140). It is determined whether 
display-mode switching operation is instructed from the 
user interface unit 5 (142). If the display-mode switching 
operation is instructed (Yes), the procedure returns to 
processing step 11 0 to perform processing according to 
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the display mode. If not instructed (No), It Is determined 
whether or not reading of the e-mail is completed (1 44). 
If not completed (No), the procedure returns to process- 
ing step 1 04 to repeat the display processing for another 

5 e-mail. If the reading of the e-mail is completed (Yes), 
the mail display processing is ended. 
[0058] On the other hand, if it Is detemnined In 
processing step 106 that there is no file (No), or In 
processing step 1 1 0 that the setting of the display mode 

10 is .text-only. (Yes), the display processing is doneforthe 
e-mail text alone. In other words, the address controller 
21 is instructed to clear all the contents on the display 
data RAM 22. Then, the character data of the e-mail text 
stored in the mail text memory 8 are output to the ad- 

15 dress controller 21 (130). After that, the procedure goes 
to processing step 140. 

[0059] In the case where only the e-mail text Is dis- 
played, the display color of the characters does not need 
to be adjusted, but part of the character setting/output 
20 means 1 5 may be used to tailor the display color of the 
characters to users liking. 

[0060] Further, if It Is determined In processing step 
112 that the display mode Is .Image-only. (Yes), the dis- 
play processing is done for the attached Image alone 

25 (1 20). Then, the procedure goes to processing step 1 40. 
[0061] The display processing for the attached image 
alone includes image-size adjustment processing for 
adjusting the size of the image to match the display area 
of the display unit 6, and the image zooming processing 

30 for zooming In or out the image in accordance with In- 
structions from the user to perform the function for var- 
ying the display scale. In particular, if scrolling is instruct- 
ed from the user interface units during enlarged display, 
processing for displaying the entire enlarged image by 

35 scrolling is performed. 

[0062] It should be noted that the Image processing/ 
output processing performed by the image processing/ 
output means 14 may be either or both of the image- 
size adjustment processing and the Image correction 

40 processing for correcting the brightness and/or contrast 
of the image. Further, in actuality, the mail display 
means 13 may realize either or both of the image 
processing/output means 14 and the character setting/ 
output means 15. 

45 [0063] Next, the operation of the portable terminal ac- 
cording to the present Invention will be described on the 
basis of Fig. 1 by referring to specific examples of dis- 
play shown in Figs. 3 to 5 . Fig. 3 shows an example of 
display on the portable terminal of the present invention 

50 on which an image and an e-mail text are overlapped. 
Fig. 4 shows an example of e-mail text-only display on 
the portable terminal of the present Invention. Fig. 5 
shows examples of image-only display on the portable 
terminal of the present Invention, where (a) shows an 

55 example of entire Image display and (b) shows enlarged 
Image display. 

[0064] According to the portable terminal of the 
present invention, the mail receiving means 11 of the 
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control unit 10 performs e-mail reception processing 
through the antenna 1 , the duplexer 2 and the receiver 
4. If the received e-mail is text-only e-mail, character da- 
ta of the text are stored In the mall text memory 8 of the 
memory unit 7. 

[0065] On the other hand, if the received e-maji is e- 
mail with image data attached thereto, the image data 
decoding means 12 is operated to detect the image data 
part attached to the e-mall text. The character data of 
the text are stored In the mail text memory 8, while the 
image data is decoded and stored in the image data 
memory 9a. 

[0066] Then , when the user instructs the display of the 
e-mail through the user interface unit 5, the display 
means 13 of the control unit 10 is activated. Suppose 
here that one of methods for displaying e-mail with Im- 
age data attached thereto (display modes) Is selected 
and set in advance from among e-mail text-only display, 
attached image-only display and display on which the 
attached image and the e-mail text are overlapped. 
However, the mode selected may be changed during 
display processing. 

[0067] If the e-mail selected from the e-mad list con- 
tains an attached Image, and the display mode Is such 
a display mode as to overlap the attached image and 
the e-mail text, the mail display means 13 activates the 
image processing/output means 14 to read out the im- 
age data from the image data memory 9a. Then, the Im- 
age processing/output means 1 4 adjusts the size of the 
image to match the display area of the display unit 6, 
and processes the image to correct the brightness and/ 
or contrast thereof to mal<e the characters easy to see 
when overlapped upon the image. The image data thus 
generated are written onto the display data RAIVI 22 
through the address controller 22. 
[0068] Next, the character setting/output means 1 5 Is 
activated to read out the character data of the e-mail 
text from the mail text memory 8. Then, the character 
setting/output means 16 selects the optimum character 
color on the basis of the chromatlcity of the Image, or 
decides on the character color changed by the user. The 
character data of the e-mail text and the character color 
are output to the address controller 21 . The address 
controller 21 converts the character data into dot data 
for the display of the characters with the specified char- 
acter color for the purpose of overlapping the characters 
upon the image. Then, the address controller 21 per- 
forms address control to write only the dot part for char- 
acter display over the image data on the display data 
RAM 22. Thus , the image and the characters are over- 
lapped on the display data RAM 22 to generate display 
data. 

[0069] The display data thus generated on the display 
data RAM 22 are output to the display unit 6 through the 
display driver 23. Then, as shown in Fig. 3, the e-mail 
text is displayed against the background of the attached 
image data. 

[0070] On the other hand, if the display mode is the 



text-only mode, the mail display means 13 instructs the 
address controller 21 to erase all the data on the display 
data RAM 22. After the address controller 21 has erased 
the data on the display data RAM 22, the character data 

5 are output to the address controller 21. The address 
controller 21 converts the character data into the dot da- 
ta for character display, and perfomns address control 
to write the dot data onto the display data RAM 22. The 
dot data written on the display data RAM 22 are output 

10 to the display unit 6 through the display driver 23 to dis- 
play only the character data of the e-mail text as shown 
In Fig. 4. 

[0071] If the display mode is changed during the e- 
mail display processing in accordance with Instructions 

15 from the user Interface unit 5, the display mode .image- 
only, can be selected. When the .image-only, display 
mode is selected, the Image processing/output means 
1 4 is activated to read out the image data from the image 
data memory 9a. Then, the image processing/output 

20 means 14 adjusts the size of the image to match the 
display area of the display unit 6. The image data thus 
generated are written onto the display data RAM 22 
through the address controller 21 , and output to the dis- 
play unit 6 through the display driver 23 to display only 

25 the image data as shown In Fig. 5(a). 

[0072] The .image-only, display mode has a function 
for varying the display scale. For example, if the user 
Instructs an enlarged display through the user interface 
unit 5, the Image processing/output means 14 is oper- 

30 ated to zoom In the received Image data and store the 
same Into the temporary Image data memory 9b. Part 
of the enlarged image data (capable of being displayed) 
Is written onto the display data RAM 22 through the ad- 
dress controller 21 , and output to the display unit 6 

35 through the display driver 23. Then, as shown In Fig. 5 
(b). the enlarged part of the attached image is so dis- 
played that the user can check detailed portions. In such 
a case, marks such as arrows shown In the display ex- 
ample are indicated to let the user know that the image 

40 screen can be scrolled. 

[0073] Then, if the user instructs scrolling through the 
user interface unit 5, the next scrolled part of the image 
data is read out from the temporary Image data memory 
9b according to the direction to be scrolled. The read 

45 part of the Image data is written onto the display RAM 
22 through the address controller 21 , and output to and 
display on the display unit 6 through the display driver 
23. 

[0074] It should be noted that the received image data 
50 stored in the image data memory 9a of the memory unit 
7 may be enlarged or zoomed In. Alternatively, the im- 
age processed to match the display size may be stored 
in the temporary Image data memory 9b so that Image 
enlargement or zooming Is done on the basis of the Im- 
55 age stored In the temporary Image data memory 9b. 
[0075] Further, if the display data RAM 22 can be of 
capacity higher than the display area of the display unit 
6, the image data of the enlarged image may be written 



7 



13 



EP1 182 639 A2 



14 



onto the display data RAM 22 so that the display driver 
23 will provide scrolling control. 
[0076] Although the above description was made 
about a case where an image Is attached to an. e-mail 
message, two or more images may be attached to the 
e-mail. In this case, the user may press specific keys 
assigned on the user interface unit 5 to change the im- 
ages in order like .image 1., .image 2. and .images., re- 
gardless of whether or not the e-mail text Is overlapped 
upon the Image. 

[0077] The above description was also made about 
the display of e-mail with image data attached thereto, 
but the present invention is not limited to e-mail recep- 
tion. For example, the present invention Is applicable to 
a display of a received Image on a receiving side in a 
system for transmitting and receiving image Infomnation. 
[0078] Suppose that Image data of an Image taken In 
with a camera or the like from the portable terminal on 
a sending side are to be transmitted to the portable ter- 
minal on the receiving side so that the image data can 
be displayed on the receiving side. Suppose further that 
character data of attached information, such as the time 
and date of the photographed image, and the name of 
the Image sender, are transmitted together with the Im- 
age data. In such a system, the character data of the 
attached infomnation, such as the time and date of the 
photographed Image and the name of the image sender, 
are displayed on the receiving side by overlapping the 
character data and the Image data. Upon overlapping 
the character data and the image data, the Image-size 
adjustment and the brightness and/or contrast correc- 
tion are done. Character color of the additional Informa- 
tion may also be adjusted to make the characters easy 
to see, 

[0079] Further, if only the image is displayed, the Im- 
age may be enlarged or zoomed in by varying the dis- 
play scale so that detailed portions of the image can be 
displayed. 

[0080] According to the embodiment of the present In- 
vention, when an e-mail message with image data at- 
tached thereto Is displayed on the portable terminal the 
display mode of which is so set that the e-mail text and 
the image data are overlapped, the image processing/ 
output means 1 4 adjusts the size of the received image 
data to match the display area of the display unit 6 so 
that the characters of the e-mail text will be overlapped 
upon and displayed against the Image. This makes pos- 
sible a quick check on the image of the e-mail with the 
image attached thereto together with the e-mail text. 
Therefore, It is possible to improve the usability of the 
portable terminal as an e-mail temninal even through it 
has limited display space compared to a personal com- 
puter or PDA, which results In handy access to e-mail 
with an image or images. 

[0081] Further, when the image and the characters 
are overlapped and displayed oh the portable temninal 
according to the present invention, the Image process- 
ing/output means 1 4 corrects the brightness and/or con- 



trast of the image. Then, the character setting/output 
means 15 analyzes the chromatlcity of the attached im- 
age as the background to select the optimum character 
color on the basis of the analysis result and correspond- 

5 ence provided in advance to the analysis result. Alter- 
natively, there may be provided the function for chang- 
ing the character color In accordance with instructions 
from the user. This makes it possible to make the at- 
tached image inconspicuous, or the characters consplc- 

10 uous, or both, and hence the characters easy to see. 
[0082] Furthermore, when the mode is to display the 
attached image only, since the portable temninal of the 
present invention has the function for varying the display 
scale, the attached image can be enlarged and dis- 

is played so that the user can check detailed portions of 
the Image. In this mode, marks such as arrows are In- 
dicated to let the user know that the Image can be 
scrolled, which gives the user easy -to- understand oper- 
ability. 

20 [0083] Furthemnore, the portable terminal of the 
present invention is not limited to the display of e-mail 
with an Image or images attached thereto, and it is ap- 
plicable to the display of image data with character data 
of additional information such as the time and date of 

25 the photographed Image and the name of the sender. 
[0084] The above-described functions according to 
the present invention can be performed on software ex- 
ecuted by the control unit 10, which makes it possible 
to provide the functions without expanding the existing 

30 configuration. 

[0085] According to one aspect of the present inven- 
tion, the portable terminal Is such that the receiver re- 
ceives the image data and the character data associat- 
ed with each other, the control unit generates such dis- 

35 play data that the associated character data are over- 
lapped upon the image data, and the display unit dis- 
plays the display data. This makes it possible to display 
the received image and character data on one screen 
in an easy-to-see manner, and hence improve its usa- 

40 bility. 

[0088] According to another aspect of the present in- 
vention, the portable terminal handles the character da- 
ta that are character data of an e-mail text and the image 
data that are image data attached to the e-mail. This 
45 nnakes It possible to display the character data of the e- 
mail together with the Image data attached to the e-mail 
on one screen In an easy-to-see manner, and hence im- 
prove its usability. 

[0087] According to still another aspect of the present 
50 invention, the portable temninal is such that the control 
unit converts the received image data into image data 
of a size corresponding to that of the display area of the 
display unit to generate display data. Therefore, even if 
the display area Is smaller than the size of the received 
55 image data, the received Image and character data can 
be displayed on one screen in an easy-to-see manner, 
thus improving its usability. 

[0088] According to yet another aspect of the present 
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invention, the portable terminal is such that the controi 
unit processes the received image data to correct either 
or both of the brightness and contrast thereof to gener- 
ate display data. Therefore, when the character data are 
overlapped upon and displayed against the background 
of the received Image data, the Image data are made 
Inconspicuous. This makes It possible to display the 
character data in an easy-to-see manner even in such 
bad condition that they are overlapped upon the Image, 
and hence improve Its usability. 
[0089] According to yet another aspect of the present 
invention, the portable terminal rs such that the control 
unit sets display color of the character data according 
to the chromatlcity of the image data to generate display 
data. Therefore, when the character data are over- 
lapped upon and displayed against the background of 
the received image data, the Image data are made In- 
conspicuous. This makes it possible to display the char- 
acter data in an easy-to-see manner even in such bad 
condition that they are overlapped with the image, and 
hence improve its usability. 

[0090] According to still another aspect of the present 
invention, the portable terminal is such that when two or 
more kinds of image data are received, the control unit 
switches the Image data to be displayed as the back- 
ground in accordance with users operation on the input 
unit. This makes it easy to change the image data to be 
displayed as the background, thus improving its usabil- 
ity. 



age data to correct either or both of the brightness 
and contrast of thereof to generate the display. 

5. A portable terminal according to claim 1 or 2 or 3, 
5 wherein said control unit sets display color of the 

received character data according to the chroma- 
tlcity of the image data to generate the display data. 

6. A portable terminal according to claim 1 or 2 or 3, 
10 wherein said control unit makes two or more display 

colors of the received character data changeable in 
accordance with users operation on said input unit. 

7. A portableterminal according to claim 1 or2, where- 
as In said control unltconverts the received image data 

Into image data of a size corresponding to that of 
the display area of said display unit, and processes 
the received image data to correct either or both of 
the brightness and contrast thereof to generate dis- 
20 play data. 

8. A portable tennina! according to claim 7, wherein 
said control unit sets display color of the received 
character data according to the chromatlcity of the 

25 image data to generate the display data. 

9. A portable terminal according to one of the preced- 
ing claims, wherein when two or more kinds of im- 
age data are received, said control unit makes the 
Image data to be displayed as the background 
changeable In accordance with users operation on 
said Input unit. 

10. A portable terminal according to one of the preced- 
ing claims, wherein said control unit makes the re- 
ceived Image data changeable in scale when they 
are converted into image data of a size correspond- 
ing to that of the display area of said display unit so 
that part of the Image data not to be displayed on 
the display area at the time can be displayed by 
scrolling. 



Claims 

1 . Aportable temninal comprising: a receiver for receiv- 
ing image data and character data transmitted in as- 35 
soclatlon with each other; an input unit for inputting 
instructions; a control unit for generating display da- 
ta from the received Image data and the character 
data; and a display unit for displaying the display 
data, wherein 

said control unit generates the display data In 
such a manner that the associated character data 
are overlapped upon and displayed against the 
background of the image data. 



20 



2. A portable terminal according to claim 1, wherein 
the character data is character data of the e-mail 
text and the Image data is image data attached to 
the e-rnall. 

3. A portable temninal according to claim 1 or2, where- 
in said control unit converts the received image data 
into Image data of a size corresponding to that of 
the display area of said display unit to generate the 
display data. 

4. A portable temninal according to claim 1 or 2 or 3. 
wherein said control unit processes the received im- 
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